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Abstract 

In PJ we studied a new type of DCGs, Datalog grammars, which 
are inspired on database theory. Their efficiency was shown to be bet- 
ter than that of their DCG counterparts under (terminating) OLDT- 
resolution. In this article we motivate a variant of Datalog grammars 
which allows us a meta-grammatical treatment of coordination. This 
treatment improves in some respects over previous work on coordina- 
tion in logic grammars, although more research is needed for testing it 
in other respects. 

Keywords: logic grammars, coordination, Datalog incremental eval- 
uation, constraints, long distance dependencies 
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1 Introduction 



In their most common implementations, logic grammars resort to list represen- 
tations of the strings being analyzed or synthesized. This list-based implemen- 
tation results in several deficiencies in logic grammars, while other deficiencies 
are inherited from Prolog. Datalog grammars were born in order to address 
all these deficiencies, namely: an infinite Herbrand Universe, non-termination, 
unnecessary recomputation, structure creation on the heap, bottleneck for 
multi-threaded execution due to the use of (sequential) list data structures, 
and inability to work directly on files. 

In Datalog grammars, a given CF grammar is automatically translated 
into an assertional representation, first proposed by Robert Kowalski, which is 
largely equivalent to the list-based one but which ensures, under appropriate 
evaluation mechanisms such as OLDT resolution, that the termination and 
complexity properties of the original CF-grammar are preserved. We have 
moreover shown that, in restricted but useful cases, this can be achieved even 
in the presence of extra arguments. 

Coordination has long been a difficult problem both in linguistics and in 
language processing. The difficulty lies in that any two constituents can be 
coordinated (even of different kind), and in that often some substring that is 
explicit in one of the conjuncts is missing in the other. For instance, Wood's 
example: 

John drove the car through and completely demolished a window. 

exhibits a missing object ( "a window") in the first conjunct, and a missing 
subject ("John") in the second. Moreover, in representing these coordinated 
sentences, say in some logical form, we must take care of not requantifying "a 
window" when we reconstitute its meaning at the missing point: the window 
driven through must be equated with the demolished one. 

While humans have in general no trouble reconstituting these missing ele- 
ments and attaching the right semantics to them, it is a challenge to efficiently 
spell out for a machine the regularities found in coordination phenomena. 

In this article we show how we can extend the incremental evaluation imple- 
mentation of Datalog grammars in order to automatically extend a grammar 
which has no rules for coordination with a meta-grammatical treatment which 
allows us to parse coordinated sentences. 

Our treatment of coordination incorporates an adaptation of recent work 
on ellipsis which resorts to the idea of parallel structures |]> §, but unlike 
these approaches which stress semantic parallelism, we use both syntactic and 
semantic parallelism. 
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2 Background 



2.1 Assertional Representation 

In DLGs, a call to analyze "the martian disappeared", for instance, compiles 
into: 

'D' (the, 0,1) . % "the" stretches between points and 1" 

'D' (martian, 1,2) . 
'D' (disappeared, 2, 3) . 

?- sentence (0,3) . % Is there a sentence between points and 3? 

while lexical rules compile into forms that use these representations accord- 
ingly, e.g.: 



noun(Pl,P2) :- 'D' (martian, PI ,P2) . 



Other grammar rules translate just as in Definite Clause Grammars, the stan- 
dard Prolog grammar formalism. 

2.2 Incremental evaluation 

In order to increase efficiency, one possible implementation for for DLGs ex- 
ploits the incremental Datalog technique of generating and maintaining data 
bottom-up. Using the well-known semi-naive evaluation algorithm, we begin 
with the set of axioms and obtain the theorems of the first " layer" by applying 
the derivation rules; then we take these theorems as new starting point, to 
derive the theorems of the second layer , and so on. Generally to derive the 
theorems of the next "layer", at least one theorem produced at the previous 
stage must be used. This process terminates when no more new theorems can 
be generated. 

2.3 Coordination 

Early work on coordination proposed meta-grammatical treatments (e.g. [T2|, 



Hj), in which the appearance of a coordinating word, or conjunction (e.g. 
"and", "or", "but") is treated as a demon. When a conjunction appears in a 
sentence of the form 

A X conj Y B 
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a process is triggered in which backing up is done in the parse history in order 
to parse Y parallel to X, and B is parsed by merger with the state interrupted 
by the conjunction. 

Thus, in Wood's example we would have: 

A= John 

X= drove his car through 
conj= and 

Y= completely demolished 
B= a window 

The reconstructed phrase should then be A X B and A Y B, with the 
warning already made re. requantification. 

We next modify this treatment and express it through DLG constraints to 
be intertwined with the incremental evaluation of a DLG grammar. We shall 
then discuss more recent views on parsing parallel structures, and extend our 
treatment by adapting some of these ideas into our DLG framework. 

3 Treating coordination through DLGs plus 
constraints 

Our idea for a Datalog treatment of coordination is also, as in the work re- 
viewed in the last section, based on the assumption that a string containing 
a conjunction contains around that conjunction two constituents which are 
being coordinated. But instead of identifying four substrings A, B, X and 
Y, we simply assume that there are two coordinating constituents, V and W, 
surrounding the conjunction, which must in general be of the same category 
and have parallel parses. Thus any missing elements in either V or W can be 
reconstructed from the other. We also adopt the heuristics that closer scoped 
coordinations will be attempted before larger scoped ones. Thus in Wood's 
example, "vp conj vp" is tried before "sent conj sent". 

Thus in that example, "John" would parse as the subject noun phrase of 
a sentence with a complex verb phrase. Therefore we have 

V= drove his car through 

W= completely demolished a window 

Because the conjunction is reached before the first verb phrase is fin- 
ished parsing ("through" analyses as a preposition introducing a prepositional 
phrase- i.e., expecting a noun phrase to follow), the unfulfilled expectation of 
a noun phrase is postponed until it can be equated with a noun phrase in W. 
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Notice that what we mean by V and W having parallel parses is not that 
they must necessarily follow the same structure to the last details, but that 
their structures must complement each other so that missing constituents in 
one may be reconstructed from the other. We further assume, for the purposes 
of this article, that they both must have the same root (in this case, a verb 
phrase root), although this assumption is not necessary in general. 

Another thing to notice is that, whereas in the first analysis of Wood's 
example we end up with two conjoined sentences, in the analysis just pro- 
posed we end up with a sentence having a verb phrase which decomposes into 
two conjoined verb phrases. Linguistically speaking, it is arguable whether 
one analysis is preferable over the other one. But computationally speaking, 
the second analysis allows us to apply our meta-grammatical treatment of co- 
ordination to sentences for which the first analysis would fail. An example 
is 

Jean mange une pomme rouge et une verte. 

This sentence cannot be split into A X conj B Y to reconstitute an unre- 
duced structure following the first analysis. On the other hand, using the 
second analysis, we can postulate 

V = une pomme rouge, W = une verte 

and require that W follow a structure parallel to that of V. This then allows 
us to reconstitute the missing noun in W. 

We now describe our proposed extension of incrementally implemented Dat- 
alog grammars in an intuitive manner, using the above example. We assume 
a simple French grammar with rules such as 

sent — > np, vp. np — > proper_noun . 

vp — > v, np. np — > det, n, adj. 

Our grammar includes no rules for coordination (but does, of course, rec- 
ognize conjunctions as such). 

Let us recall that, in a Datalog grammar, our input string would be repre- 
sented as: 

Jean 1 mange 2 une 3 pomme 4 rouge 5 et 6 une 7 verte 8. 

The idea is simply to check, at every step of the incremental derivation 
of the theorems, whether a theorem conj(N,M) has been derived. As soon as 
one is, a constraint is added to the effect that, in some subsequent step of 
the incremental derivation of theorems, a constituent of category Cat must be 
found between some point Z and the point N, such that the same category 
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stretches between M and some later point P; and that finding them implies 
that the string between Z and P must also have category Cat. 
This constraint can be noted: 

C= {Cat(Z.N) isomorphic with Cat(M.P) ==> add Cat(Z,P)} 

As soon as one of these predictions is fulfilled (e.g. when we have found 
a noun phrase "une pomme rouge" between Z=2 and N=5), we can further 
specify the other prediction to follow the same structure as that of the found 
noun phrase, which will allow us to reconstruct any missing elements. 

Notice that backtracking can occurQ. For instance, the machine will first 
postulate that the conjoined categories must be "adjective", and that Z=4 
(this would be a good guess for the sentence: "Jean mange une pomme rouge 
et verte" ). But in our sample sentence, this first try will fail to find an adjective 
starting at point M=6, so backtracking would undo the bindings and suspend 
the constraint until other suitable candidates for "Cat" and "Z" are derived. 

We next present a step-by-step follow up for the example given. Sequences 
of theorems derived are noted Tl, T2, etc.; whereas sets of constraints are 
noted Cl,C2,etc. 

Tl= -CD' (jean, 0,1) , . . . , 'D' (rouge, 7, 8)}. 

T2= Tl union {n(0,D, v(l,2), det(2,3), n(3,4), adj(4,5), conj(5,6), 
det(6,7), adj(7,8)> 

C2 = { Cat(Z,5) isomorphic with Cat(6,P) ==> add Cat(Z,P)> 

tries Z=4 and fails. So the constraint suspends until something else of the 
form Cat(Z,5) appears. 

T3 = T2 union {np(2,5), np(0,l)} 

tries Z=2, and uses top-down prediction to find a (possibly incomplete) noun 
phrase stretching from point 6 to some point P, e.g. through the rule: 

np(6,P):- det(6,X), n(X,Y) ,adj (Y,P) . 

succeeds with substitutions X=7, Y=7,P=8 

1 This means, in case of Prolog's usual execution strategy that something like linear 
implication |tJ should be used instead of asserting to the dynamic database. Even more 
appropriate for this purpose is BinProlog's linear assumption operator assumel/1 0, which 
ensures that the assumed facts scope will range over the 'continuation' i.e. it will be true in 
all future computations belonging the same resolution branch. 
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T4 = T3 union {np(6,8)> union {np(2,8)> 

T5 = T4 union {vp(l,8)} 

T6 = T5 union {s(0,8)} 

Notice that, at the point in which the constraint succeeds with substitutions 
X=7, Y=7, if the grammar included arguments for semantic representation, 
the semantic representations for the two nouns would be unified, given that 
one of them is missing (as shown by the fact that its starting point, 7, is the 
same as its ending point). We shall later give a full example involving semantic 
representations. 

4 Related work on ellipsis 

A notion that is central to recent work on ellipsis, and which has been present 
in embryonic form, as we have seen, even in the early work on coordination, is 
that of parallelism as a key element in the determination of implicit meanings. 
Asher [|J defines parallelism as 

a pairing of constituents ... and their parts, such that each pair 
contains two semantically and structurally similar objects 

U describes an elliptical construction as 

one involving two phases (usually clauses) that are parallel in struc- 
ture in some sense. 

|J, following ||, also postulates the necessity, within a feature-structure set- 
ting, of combining elements which exhibit a degree of syntactic-semantic par- 
allelism in order to determine the way in which some kinds of anaphora are 
resolved, and argue that the use of default unification (or priority union) im- 
proves on Priist's operation for combining the parallel structures. 

Although the analysis of || precedes that of |J, the latter may be easier 
to follow, so we shall discuss it first. 

Intuitively, default unification takes two feature structures, one of which 
(called the TARGET) is identified as "strict", while the other one (called the 
SOURCE) is "defeasible", and combines the information in both such that 
the information in the strict structure takes priority over that in the defeasible 
structure. For instance, the combination of the feature structures shown below 
for sentences la and lb 
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la. Hannah likes beetles. 

[ AGENT Hannah 

PATIENT beetle] 
likes 

lb. So does Thomas 

[ AGENT Thomas] 
agent ive 

results in the priority union: 

[ AGENT Thomas 

PATIENT beetle] 
likes 

Thus, the implicit constituent in the second sentence is reconstituted from 
the first by using a generally applicable procedure on the representations of 
the parallel structures. 

|| postulated a similar analysis, but it was based on A-calculus semantic 
representations, and used higher order unification. 

For instance, in their example: 

Dan likes golf, and George does too. 

they identify the antecedent or source as the complete structure ("Dan likes 
golf), whereas the target clause ("George does too") is either missing, or 
contains only vestiges of, material found overtly in the source. 
Their analysis of such structures consists of: 

a) determining the parallel structure of source and target; 

b) determining which are parallel elements in source and target (e.g., "Dan" 
and "George" are parallel elements in the example); 

c) using Huet's higher-order unification algorithm || for finding a property P 
such that P(s\, s n ) = S, 

where s\ through s n are the interpretations of the parallel elements of the 
source, and s is the interpretation of the source itself. Only solutions which 
do not contain a primary occurrence of the parallel elements are considered 
(occurrences are primary if they arise directly from the parallel elements, as 
opposed to those arising for instance from a pronoun). 
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In the example, 

P(dan) = likes (dan, golf ) 

is solved by equating P with 
Ax. likes(x,golf) 

given that the other possible solution, Ax. likes(dan,golf) contains a primary 
occurrence of the parallel element, "dan", and must therefore be discarded. 

d) applying the property on the representation of the target, e.g. 
P(george)= [Ax.likes(x,golf)] george = likes(george,golf) 

e) conjoining the meanings of the source and of the target thus completed, 
e.g.: 

likes (dan, golf ) & likes (george, golf ) 

Both || and || provide ambiguous readings of discourses such as 
Jessy likes her brother. So does Hannah. 

can be provided, unlike previous analyses, without having to postulate am- 
biguity in the source (this is achieved in || by allowing for priority union to 
either preserve or not preserve structure-sharing information in the source, and 
in || by the distinction between primary and secondary occurrences of par- 
allel elements). Another notable point in both these approaches is that they 
address the issue of semantic parallelism, which in most previous approaches 
was understressed in favor of syntactic parallelism. 

However, both methods share the following limitations: 

a) neither method formulates exactly how parallelism is to be determined- it 
is just postulated as a prerequisite to the resolution of ellipsis (although |5| 
speculates on possible ways of formulating this, leaving it for future work) 

b) both approaches stress semantic parallelism, while pointing out that this is 
not sufficient in all cases 

By examining ellipsis in the context of coordinated structures, which are 
parallel by definition, and by using extended DLGs, we provide a method 
in which parallel structures are detected and resolved through syntactic and 
semantic criteria, and which can be applied to either grammars using different 
semantic representations- feature structure, A-calculus, or other. We exemplify 
using a logic based semantics along the lines of || . 
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4.1 Our semantico-syntactic treatment of parallelism 

Let us now consider the string 

John drove the car through and demolished a window 
01 234 56 78 9 

where we have indicated the connections as numbers in between the words. 
We use the following grammar: 

sent(Sem) — > np (X, Scope, Sem) , vp(X, Scope). 

np(X, Scope, Sem) — > det(X, Restriction, Scope, Sem) , noun(X, Restriction) . 
np(X,Sem,Sem) — > name(X) . 

vp(X,Sem) — > verbO(X,Sem) . 

vp(X,Sem) — > verbl(X,Y,S0) , np(Y,S0,Sem) . 

vp(X,Sem) — > verb2(X,Y,Z,S0) , np(Y,S0,Sl), pp(Z,Sl,Sem) . 

pp(X,S0,Sem) — > prep(_), np(X,S0,Sem) . 

verbO(X, laugh (X)) — > [laughed]. 
verbl(X,Y,ate(X,Y)) — > [ate]. 
verbl(X,Y,saw(X,Y)) — > [saw]. 
verbl(X,Y, heard (X,Y)) — > [heard]. 
verbl(X,Y, demolished (X,Y)) — > [demolished]. 
verb2(X,Y,Z,drove_through(X,Y,Z)) — > [drove]. 
verbl(X,Y,sat_at(X,Y)) — > [sat]. 

det(X, Scope, Restriction, exists(X, Scope, Restriction)) — > [a]. 
det(X, Scope, Restriction, exists(X, Scope, Restriction)) — > [an], 
det (X, Scope , Restriction, def (X, Scope Restriction) ) — > [the], 
det (X, Scope , Restriction, each(X, Scope, Restriction) ) — > [each]. 

noun (X, man (X) ) — > [man]. 
noun(X, woman (X) ) — > [woman], 
noun (X, apple (X)) — > [apple], 
noun (X, pear (X) ) — > [pear]. 
noun(X, window (X) ) — > [window]. 
noun(X,table(X)) — > [table], 
noun (X, train (X) ) — > [train], 
noun (X, car (X) ) — > [car]. 

name(john) — > [john] . 
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name (mary) — > [mary] 



prep (through) — > [through] . 
prep (at) — > [at] . 

conj (and) — > [and] . 

Tl would contain the 'D' connections for this sentence, and T2 adds: 

{name (john, 0,1) , verb2(X,Y,Z, drove_through(X,Y,Z) , 1 ,2) , 
det(Y,R,Sc,the(Y,R,Sc) ,2,3) , noun(Y,car(Y) ,3,4) , 
prep (through, 4, 5) , conj (and, 5,6) , verbl(Xl,Yl, 
demolished (XI, Yl) ,6,7) , det(W,Rl,Scl,a(W,Rl,Scl) ,7,8) , 
noun (V, window (V) ,8,9)} 

At this point, a constraint to find points P and Q such that Cat(. . . ,P,5) 
is parallel to Cat(. . . ,6,Q) is generated (upon whose finding, something of 
the form Cat(. . . , P,Q) will be added to the set of theorems Q), and this 
constraint suspends until the following new theorems have been derived: 

T4= T2 union {np(john,Sem,Sem) , np(Y,Sc,the(Y,car(Y) ,Sc) ,2,4) , 
np(W,Scl , a (W, window (W) ,Scl) ,7,9) , vp (X, a (W, window (W) , 
demolished (X,W) ,6,9)} 

We can now postulate Cat= vp and use top-down prediction to derive a (pos- 
sibly incomplete) vp ending at point 5. When trying rule 

vp(X,Sem) — > verb2(X,Y,Z,S0) , np(Y,S0,Sl), pp(Z,Sl,Sem) . 

and after development of the pp, we can adapt the analysis of || and identify: 
SOURCE NP: 

np(W, demolished (X,W) , a (W, window (W) , demolished (X, W) ) ,2,4) 
TARGET NP: 

np (Z , the (Y , car (Y) , drove_through (X , Y , Z) , Sem ' ,5,5) 



2 We shall describe below the constraints that this addition must satisfy. 
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Now we can build an abstract NP by abstracting over the Scope argument of 
the source, and postulating an empty surface string (i.e., by equating the start 
and end points of the string): 

ABSTRACTED NP : 

np(W, Scope, a ( W, window (W) .Scope) ,P,P) 

We now unify the abstracted NP with the target NP to obtain the resolved 
target NP: 

RESOLVED TARGET NP: 

np(W,the(Y,car(Y) ,drove_through(X,Y,W) , a(W, window (W) ,the(Y,car(Y) , 
drove_through(X,Y,W) ,5,5) 

which in turn completes the target vp: 
RESOLVED TARGET VP: 

vp(X' ,a(W,window(W) ,the (Y, car (Y) ,drove_through(X,Y,W) ) ) ,1,5) 

The constraint now reads: 

C2'= {vp(X' , a (W, window (W) ,the(Y,car(Y) , drove_through (X , Y , W) , 1 , 5) 
parallel to 

vp(X,a(V,window(V) ,demolished(X,V) ,6,9) } 

Now we need to conjoin the parallel structures. This is done by what we call 
c-unif ication: unify the parts in the parallel terms which are unifiable, and 
conjoin those that are not (i.e., the parallel elements), with the exception of the 
last two arguments, which are generating from the two pairs of last arguments 
P1-P2 and P2+1-P3 of the parallel structures, as PI and P3 []. We obtain: 

vp (X, a (W, window (W) , and (the (Y, car (Y) ,drove_through(X,Y,W) ) , 
demolished(X,W)) ,1,9) 

After this theorem's addition, the sent rule can apply to derive 

sent (a ( (W, window (W) , and (the (Y, car (Y) ,drove_through(john,Y,W) ) , 
demolished(john,W) ) , 1 ,9) 

3 Of course, for other types of coordination we use the appropriate connective: "but", 
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5 Discussion 



The previous section shows that when we introduce syntactic as well as se- 
mantic parallelism, this can help determine which are the parallel structures 
automatically, by incremental application of a Datalog grammar constraint 
on coordination coupled with top-down prediction to complete any missing 
structures through an analysis of parallelism that is inspired in that of || but 
complements it in various ways. Syntactic criteria on the determination of 
parallelism that can be found in the literature can also, of course, be added to 
complement this initial proposal. 

Several observations are in order. In the first place, we must note that a 
simple conjoining of the representations obtained for the parallel structures as 
proposed in H may not, as the example of the previous section shows, suffice. 
Since these structures are quite dissimilar, we must conjoin only the parallel 
elements. We postulate that the parallel elements will be represented by those 
subterms which are not unifiable. 

Secondly, our notion of abstraction, which relies on converting into a vari- 
able those parts of a semantic representation which are contributed by the 
constituent that contains it, can be adapted to suit other semantic represen- 
tations, provided that we can identify for them which part of the semantic 
representation each rule for a constituent contributes to the overall represen- 
tation. This is not an unreasonable expectation for compositionally defined 
semantics. 

In the third place, we should note that our analysis allows for the source 
clause to not necessarily be the first one- again as the example we just examined 
shows, we can have structures in which the incomplete substructure does not 
antecede the complete one. Thus our analysis can handle more cases than 
those in previous related work. 

Note that some special cases allow to use unification between isomorphical 
objects to obtain the proper quantification. By slightly modifying the grammar 
as 

np(X, Scope, Sem) — > 

npO (X, Scope, Sem) . % previously defined as np/3 

np(X, Scope, and (Semi, Sem2)) — > 
npO(X, Scope, Semi) , 
conj (and) , 
np (X , Scope , Sem2) . 

we can handle directly phrases like: 
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Each man ate an apple and a pear. 



each 
I 



VO man and 
I I 



VO exists exists 

I I 



VI apple ate VI pear ate 
I I II 

III III 

VI VO VI VI VO VI 

Clearly this works only for a class of particular constraints exhibiting strong 
isomorphism in the constructed meaning. For instance, noun groups of the 
form npi and np2 and np^ do have this property. 

We must note, however, that in some cases we will need to complement 
our analysis with a further phase which we shall call "reshaping". Take for 
instance the sentence "Each man and each woman ate an apple". Since both 
parallel structures are complete, we do not need to perform abstraction and 
c-unif ication, but we do need to reshape the result of the analysis through 
distribution, thus converting 

each (X, man (X)&woman(X) , exists (Z, apple (Z) ,ate(X,Z) ) 
into 

and ( each (X, man (X) , exist s(Z, apple (Z) ,ate(X,Z)) , 
each (X, woman (X) , exist s(Z, apple (Z) , ate(X,Z))) 

Reshaping operations have been used in fU, and are useful in particular to 
decide on appropriate quantifier scopings where coordination is involved. It 



14 



would be interesting to study how to adapt these operations to the present 
work. 

Another interesting observation is that the results in H concerning the 
use of the distinction between primary and secondary occurrences of parallel 
elements in order to provide ambiguous readings of discourses such as "Jessie 
likes her brother. So does Hannah." could in principle be transferred into our 
approach as well. 

Let us also note that, as observed in the notion of compositional se- 
mantics of the two clauses (on which the related previous work, and ours to 
some extent, is based) is not enough in some cases. For instance, consider: 

If Fred drinks, half the bottle is gone. 
But if Sam drinks too, the bottle is empty. 

In this sentence, the conclusion which holds if Fred drinks BUT SAM DOES 
NOT, does not hold if both Fred and Sam drink. The implicit information that 
the first conclusion holds only if the premiss of the second sentence does not 
hold must be inferred. Using our approach, we could use the re-shaping phase 
to deal with cases such as this one, in which the presence of words such as 
"too" would trigger the generation of the full reading. A sentence of the form 

If Fred drinks, CI, but if Sam drinks too, C2. 



would generate a representation such as 

but (if (drink (f red) ,C1) , if (too (drink (sam) ) ,C2)) 



which after reshaping would become: 

and(if (and (drink (f red) , no (drink (sam) ) ,C1) , 
if (and(drink(fred) ,drink(sam) ,C2))) 



Finally, let us point out that, unlike most current efforts on programming 
with constraints, the constraints we propose in this paper do not limit them- 
selves to pruning the search space, but actively contribute to finding a solution. 
In this sense they relate more to database work such as [10| than to the liter- 
ature in either constraint logic programming or constraint logic grammars. 
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